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Dimension  Reduction  Near  Periodic  Orbits  of  Hybrid  Systems:  Appendix 

Samuel  Burden,  Shai  Revzen  and  S.  Shankar  Sastry 


Abstract — When  the  Poincare  map  associated  with  a  periodic 
orbit  of  a  hybrid  dynamical  system  has  constant-rank  iter¬ 
ates,  we  demonstrate  the  existence  of  a  constant-dimensional 
invariant  subsystem  near  the  orbit  which  attracts  all  nearby 
trajectories  in  finite  time.  This  result  shows  that  the  long¬ 
term  behavior  of  a  hybrid  model  with  a  large  number  of 
degrees-of-freedom  may  be  governed  by  a  low-dimensional 
smooth  dynamical  system.  The  appearance  of  such  simplified 
models  enables  the  translation  of  analytical  tools  from  smooth 
systems — such  as  Floquet  theory — to  the  hybrid  setting  and 
provides  a  bridge  between  the  efforts  of  biologists  and  engineers 
studying  legged  locomotion. 

I.  Introduction 

Dynamic  multi-legged  locomotion  presents  a  daunting 
control  task.  A  large  number  of  degrees-of-freedom  (DOF) 
must  be  rapidly  and  precisely  coordinated  in  the  face  of 
state  and  environmental  uncertainty.  The  ability  of  indi¬ 
vidual  limbs  to  exert  forces  on  the  body  varies  intermit¬ 
tently  with  ground  contact,  body  posture,  and  the  efforts  of 
other  appendages.  Finally,  the  motion  itself  affects  sensor 
measurements,  complicating  pose  estimation.  In  spite  of 
these  difficulties,  animals  at  all  levels  of  complexity  have 
mastered  the  art  of  rapid  legged  locomotion  over  complex 
terrain  at  speeds  far  exceeding  those  of  comparable  robotic 
platforms  [1],  [2],  [3],  [4], 

Numerous  architectures  have  been  proposed  to  explain 
how  animals  control  their  limbs.  For  steady-state  locomotion, 
most  posit  a  principle  of  coordination,  synergy,  symmetry  or 
synchronization,  and  there  is  a  surfeit  of  neurophysiological 
data  to  support  these  hypotheses  [5],  [6],  [7],  [8].  In  effect, 
the  large  number  of  DOF  available  to  an  animal  are  collapsed 
during  regular  motion  to  a  low-dimensional  dynamical  at¬ 
tractor  that  may  be  captured  by  a  template  model  embedded 
within  a  higher-dimensional  model  anchored  to  the  animal’s 
morphology  [9],  [10].  In  this  view,  only  a  few  parameters  like 
frequency  and  coupling  strength  are  required  to  describe  the 
dynamics  of  any  particular  periodic  gait  over  a  broad  range 
of  animal  morphologies,  offering  a  tantalizing  target  for  ex¬ 
perimental  biologists.  Were  the  dynamics  of  legged  animals 
smooth  as  a  function  of  position  and  momentum,  Floquet 
theory  [11]  provides  a  canonical  form  for  the  structure  of  the 
stability  basin  of  a  limit  cycle  [12],  [13].  In  such  a  canonical 
form,  the  template  may  appear  as  an  invariant  attractor  of 
the  linearized  dynamics  and  be  amenable  to  quantitative 

S.  Burden  and  S.  Sastry  are  with  the  Department  of  Electrical  Engineering 
and  Computer  Sciences,  University  of  California  at  Berkeley,  CA,  USA 
sburden, sastry@eecs .berkeley . edu 

S.  Revzen  is  with  the  Department  of  Electrical  and  Systems 
Engineering,  University  of  Pennsylvania,  Philadelphia,  PA,  USA 
shrevzen@seas . upenn . edu 


Fig.  1.  Illustration  of  the  main  result  in  a  two-domain  system:  Whenever 
iterates  of  the  Poincare  map  P  associated  with  a  periodic  orbit  7  of  a  hybrid 
dynamical  system  are  constant-rank,  there  is  a  constant-dimensional  smooth 
submanifold  Mj  in  each  domain  Dj  which  is  invariant  under  the  flow  of 
the  vector  field  Fj  and  which  attracts  all  trajectories  starting  in  an  open  set 
Wj  C  Dj  containing  7  in  finite  time. 


measurement  [14],  [15].  A  substantial  motivation  for  the 
present  work  has  been  to  provide  a  theoretical  framework  for 
applying  this  empirical  approach  to  study  legged  locomotion. 
The  dynamics  of  legged  locomotion  are  rarely  smooth  due 
to  intermittent  contact  of  limbs  with  the  substrate,  so  we 
have  generalized  this  approach  to  be  aplicable  to  a  class  of 
non-smooth  systems  called  hybrid  dynamical  systems. 

We  relegate  a  formal  definition  of  the  class  of  hybrid 
systems  under  consideration  to  Section  III.  Informally,  hybrid 
dynamical  systems  are  comprised  of  differential  equations 
written  over  disparate  domains  together  with  rules  for  switch¬ 
ing  between  the  domains.  Of  particular  interest  to  us  are 
periodic  orbits  of  such  systems.  From  a  modeling  viewpoint, 
a  stable  hybrid  periodic  orbit  provides  a  natural  abstraction 
for  the  dynamics  of  steady-state  legged  locomotion.  This 
approach  has  been  widely  adopted,  generating  a  variety  of 
models  of  bipedal  [16],  [17],  [18]  and  multi-legged  [19],  [20] 
locomotion  as  well  as  some  general  control-theoretic  tech¬ 
niques  for  composition  [21],  coordination  [22],  and  stabiliza¬ 
tion  [23],  [24],  [25]  of  such  models.  In  certain  cases,  it  has 
been  possible  to  formally  embed  a  low-dimensional  abstrac¬ 
tion  in  a  higher-dimensional  physically-realistic  model  [26], 
[27], 

This  paper  provides  a  conceptual  link  between  formal 
analysis  of  hybrid  periodic  orbits  and  the  dramatic  dimension 


reduction  observed  empirically  in  successful  legged  loco¬ 
motors.  Under  the  condition  that  iterates  of  the  Poincare 
map  associated  with  a  periodic  orbit  are  constant  rank, 
we  demonstrate  the  existence  of  a  constant-dimensional 
invariant  subsystem  which  attracts  all  nearby  trajectories  in 
finite  time.  Analogous  results  for  smooth  dynamical  systems 
typically  impose  stringent  assumptions  on  the  dynamics  such 
as  exact  symmetries  (cf.  §8.9  in  [28])  or  timescale  separation 
(cf.  Chapter  4  in  [13]).  In  contrast,  the  results  of  this  paper 
imply  that  hybrid  dynamical  systems  may  exhibit  dimension 
reduction  near  periodic  orbits  solely  due  to  the  interaction 
of  the  switching  dynamics  with  the  smooth  flow. 

Organization 

The  hybrid  systems  we  consider  are  constructed  using 
switching  maps  defined  between  boundaries  of  smooth  dy¬ 
namical  systems.  The  behavior  of  such  systems  can  be 
studied  by  alternately  applying  flows  and  maps.  Thus,  we 
begin  in  Section  II  by  developing  several  results  which 
provide  canonical  forms  for  the  behavior  of  flows  and  maps 
near  periodic  orbits  and  fixed  points,  respectively.  Then, 
we  define  hybrid  systems  in  Section  III  and  use  these 
results  to  characterize  the  dynamics  near  their  periodic  orbits. 
Examples  are  presented  in  Section  IV  and  implications  of  the 
results  for  the  design  and  analysis  of  legged  locomotors  are 
explored  in  Section  V. 

II.  Smooth  Dynamical  Systems 

This  section  contains  three  technical  results  used  in  the 
proof  of  the  Theorem  of  Section  III.  The  first  two  results 
concern  smooth  dynamical  systems1  and  may  be  found  in 
textbooks,  hence  we  state  them  without  proof.  The  third 
establishes,  under  a  non-degeneracy  condition,  a  canonical 
form  for  the  invariant  set  of  a  smooth  map  near  a  fixed 
point.  A  reader  interested  in  the  main  result  of  this  paper  may 
proceed  to  Section  III  and  refer  to  this  section  as  needed. 

A.  Differential  Geometry 

We  assume  familiarity  with  the  tools  and  terminology  of 
differential  geometry.  If  any  of  the  concepts  we  discuss  are 
unfamiliar,  we  refer  the  reader  to  [28],  [29]  for  more  details. 

Definition  1.  A  smooth  dynamical  system  is  a  pair  (M,  G): 

M  is  a  smooth  manifold  with  boundary  dM; 

G  is  a  smooth  vector  field  on  M,  i.e.  G  £  7(M). 

B.  Flows  Between  Surfaces 

We  review  the  fact  that  the  flow  near  a  trajectory  pass¬ 
ing  transversally  between  two  surfaces  has  a  simple  form 
(cf.  Chapter  11.2  in  [30]).  In  particular,  nearby  trajectories 
can  be  obtained  from  an  embedding  of  a  product  manifold. 
This  will  be  the  prototype  for  the  dynamics  near  a  periodic 
orbit  in  one  domain  of  a  hybrid  system. 

1  For  notational  convenience,  we  work  with  objects  which  possess  con¬ 
tinuous  derivatives  of  all  orders.  However,  the  results  in  this  paper  are  valid 
if  we  only  assume  continuous  differentiability. 


Lemma  1.  Let  ( M ,  G )  be  a  smooth  dynamical  system  and 
<f> :  7  — >  M  its  maximal  flow.  Suppose  T,  S  C  M  are  smooth 
embedded  submanifolds,  S  has  codimension  1,  cf>(a ,  ()  £  S 
for  some  a  >  0  and  (eT  where  G  is  transverse  to  T  at  £ 
and  S  at  cf>(a,(;).  Then  we  have  the  following  consequences: 

(i)  there  is  a  neighborhood  U  C  M  containing  t;  and  a 
smooth  map  p  :  U  — »  R.  so  that  p(ff)  =  a  and  for  all 
x  €  U,  p(x)  >  0  and  <p(p(x),x)  €  S;  p  is  called  the 
time-to-impact  map; 

(ii)  with  V  :=  U  D  T,  the  map  tj)  :  [0, 1]  x  V  — >  M  with 

tp(a,v)  :=  <j>(p(v)a,v) 

is  a  smooth  embedding  into  M  whose  image  contains 
the  trajectory  7  =  {<p(t,  £)  :  0  <  t  <  q-}. 

Remark  1.  This  lemma  is  applicable  when  T,  S  C  dM, 
which  will  be  relevant  in  the  study  of  hybrid  systems. 

C.  Gluing  Flows 

In  this  section,  we  provide  a  method  for  gluing  two  smooth 
dynamical  systems  together  along  their  boundaries  to  obtain 
a  new  smooth  system;  this  construction  uses  basic  results 
from  differential  topology  (cf.  Theorem  8.2.1  in  [31]).  We 
will  use  this  construction  in  Section  III  to  attach  distinct 
hybrid  domains  to  one  another. 

Lemma  2.  Suppose  (Mi,  Gf),  (M2,  G2)  are  smooth  n- 
dimensional  dynamical  systems,  p  :  dM\  — >  dM2  is  a 
dijfeomorphism,  G\  is  outward-pointing  along  dMi  and  G2 
is  inward-pointing  along  dM2.  Then  the  topological  quotient 
M  :=  can  be  made  into  a  smooth  manifold  for 

which  (i)  the  inclusions  Mj  °-s-  M  are  smooth  embeddings 
and  (ii)  there  is  a  smooth  vector  field  G  £  T (M)  that 
restricts  to  Gj  on  Mj,  j  =  1,2. 

Remark  2.  The  smooth  structure  described  in  Lemma  2  is 
unique.  Further,  if  G\  and  G2  are  any  other  smooth  vector 
fields  on  M\  and  M2  which  satisfy  the  hypotheses  of  the 
Lemma,  the  corresponding  quotient  M  is  dijfeomorphic  to 
M  (cf.  Chaper  8  in  [31]). 

D.  Invariant  Set  of  a  Smooth  Map  Near  a  Fixed  Point 

In  studying  hybrid  dynamical  systems,  we  encounter 
smooth  maps  /  :  M  — >  M  which  are  not  diffeomorphisms. 
Viewing  iteration  of  f  as  a  discrete  dynamical  system,  we 
wish  to  study  the  behavior  of  these  iterates  near  a  fixed  point 
/(£)  =  £.  Note  that  if  /  has  constant  rank  equal  to  k  £  N, 
then  its  image  f(M)  C  M  is  an  embedded  fc-dimensional 
submanifold  near  £  by  the  Rank  Theorem  (cf.  Theorem  7.13 
in  [29]).  With  an  eye  toward  dimension  reduction,  one  might 
hope  that  the  composition  (/  o  /)  :  M  — >  f(M)  is  also 
constant-rank,  but  this  is  not  generally  true2.  If  it  is  true 
that  iterates  of  /  are  eventually  constant-rank  near  the  fixed 
point  £,  then  one  can  study  the  behavior  of  these  iterates  by 
restricting  the  domain  to  a  lower-dimensional  submanifold. 

2Consider  the  map  /  :  R2  — >  R2  defined  by  f(x,y )  :=  ( x2,x ). 


Lemma  3.  Let  M  be  a  smooth  manifold,  f  :  M  — >  M  a 
smooth  map  with  /(£)  =  £  for  some  £  £  M,  suppose  the 
rank  of  f  is  bounded  above  by  n  £  N,  and  suppose  the 
composition  of  f  with  itself  n  times,  f  n,  has  constant  rank 
equal  to  r  £  N  on  a  neighborhood  of  £.  Then  fn(M )  is 
an  r-dimensional  embedded  submanifold  near  £  and  there 
are  neighborhoods  U,  V  C  fn(M )  containing  £  for  which  f 
maps  U  diffeomorphically  onto  V. 

In  the  proof  of  Lemma  3,  we  make  use  of  an  elementary 
fact  from  linear  algebra.  The  result  is  easily  obtained  by 
passing  to  the  Jordan  form. 

Proposition  1 .  If  A  £  Wl  x  r"  and  rank  A  <  n,  then 
rank  (A2")  =  rank(A"). 

Proof  (of  Lemma  3)  By  the  Rank  Theorem  (cf.  Theorem 
7.13  in  [29]),  there  is  a  neighborhood  N  C  M  of  £  for  which 
E  :=  fn(N )  is  an  r -dimensional  embedded  submanifold  and 
by  Proposition  1  we  have 

rank  (/”|e)»  (0  =  rank(/™  o  /")*(£) 

=  rank  /”  (£) . 

Therefore  (/”|s)*  :  T^E  —>  T^E  is  a  bijection,  so  by  the 
Inverse  Function  Theorem  (cf.  Theorem  7.10  in  [29]),  there 
is  a  neighborhood  W  C  E  containing  £  so  that  fn(W )  C  E 
and  fn\w  '■  W  —>  fn(W)  is  a  diffeomorphism. 

By  continuity  of  /,  there  is  a  neighborhood  L  C  N 
containing  £  for  which  f(L)  C  N  and  fn(L)  C  W.  The 
set  U  :=  fn(L)  is  a  neighborhood  of  £  in  E.  Further,  we 
have 

t)  =  /o/"(i)  =  /”o/(i)cE. 

The  restriction  fn\u  '■  U  — >  fn(U)  is  a  diffeomorphism  since 
£/  C  IF,  whence  /|[/  is  a  diffeomorphism  onto  its  image, 
F  :=  f(U)  C  S.  □ 

III.  Hybrid  Dynamical  Systems 

We  describe  a  class  of  hybrid  systems  useful  for  modeling 
legged  locomotion,  then  restrict  our  attention  to  the  behavior 
of  such  systems  near  periodic  orbits.  It  was  shown  in  [32] 
that  the  Poincare  map  of  a  hybrid  system  is  generally  not  full 
rank.  We  explore  the  geometric  consequences  of  this  rank 
loss  and  demonstrate,  under  a  non-degeneracy  condition,  the 
existence  of  a  smooth  invariant  subsystem  which  attracts  all 
nearby  trajectories  in  finite  time. 

A.  Hybrid  Differential  Geometry 

For  our  purposes,  it  is  expedient  to  define  hybrid  dynam¬ 
ical  systems  over  disjoint  unions  of  smooth  manifolds. 

Definition  2.  A  smooth  hybrid  manifold  is  a  finite  disjoint 
union  of  connected  smooth  manifolds  M  =  Iljej  Mj. 

Remark  3.  The  dimensions  of  the  constituent  manifolds  are 
not  required  to  be  equal. 

Differential  geometric  constructions  which  are  confined 
to  a  single  manifold  have  natural  generalizations  to  such 
spaces,  and  we  will  prepend  the  modifier  “hybrid”  to  make  it 


clear  when  this  generalization  is  being  invoked.  For  instance, 
the  hybrid  tangent  bundle  TM  is  the  disjoint  union  of 
the  tangent  bundles  TMj,  the  hybrid  boundary  dM  is  the 
disjoint  union  of  the  boundaries  OMj,  and  a  hybrid  open 
set  U  C  M  is  obtained  from  a  disjoint  union  of  open  sets 
Uj  C  Mj.  Generalizing  maps  between  manifolds  requires 
more  care,  hence  we  provide  explicit  definitions. 

Assumption  1.  To  simplify  the  exposition,  we  henceforth  as¬ 
sume  all  manifolds  and  maps  between  manifolds  are  smooth. 

Definition  3.  A  hybrid  map 

/  :  II  Mi  ^  II  ^ 

jeJ 

between  hybrid  manifolds  restricts  to  a  map  /|m3  :  Mj 
Nf,  some  £  £  L,  for  each  j  £  J.  The  hybrid  map  is  called 
constant-rank  injective,  or  surjective  if  each  f\  m  is  as  well. 
It  is  called  an  embedding  if  each  f\M  is  an  embedding  and 
f  is  a  homeomorphism  onto  its  image. 

Definition  4.  The  hybrid  pushforward  /*  :  TM  — >  TN  is 
the  hybrid  map  defined  piecewise  as  f*\rM  ;=  (/Im,  )*- 

Definition  5.  A  hybrid  vector  field  on  a  hybrid  manifold 
M  :=  YljejMj  is  a  hybrid  map  G  :  M  — >  TM  for  which 
G|mj  is  a  vector  field  on  Mj,  i.e.  G|m3  G  7(Mj).  We  let 
T (M)  denote  the  space  of  hybrid  vector  fields  on  M. 

To  state  the  main  result  of  this  paper,  we  need  to  embed 
manifolds  into  hybrid  manifolds.  This  can  be  achieved  by 
first  partitioning  the  smooth  manifold  to  obtain  a  hybrid 
manifold,  then  embedding  this  hybrid  manifold  via  the 
previous  definitions. 

Definition  6.  A  partition  of  an  n-dimensional  manifold 
M  is  a  finite  set  of  embedded  n-dimensional 

submanifolds  Mj  C  M  for  which  [J  eJ  Mj  =  M  and  if 
i  j  we  have  Int (Mj)  n  Int(Mj)  =  0. 

Definition  7.  A  hybrid  embedding  of  a  manifold  M  into  a 
hybrid  manifold  N  :=  ]J  .g  j  Nj  is  determined  by  a  partition 
{Mj\  je  J  of  M  and  a  hybrid  embedding 

/  II  II  v, 

jeJ  j&J 

for  which  fj  :  Mj  — »  Nj  for  each  j  £  J.  Any  G  £  T(M) 
may  be  pushed  forward  to  a  unique  /* G  £  7 (/(M)).  The 
image  of  f  is  a  hybrid  embedded  submanifold. 

With  these  preliminaries  established,  we  can  define  the 
class  of  hybrid  systems  considered  in  this  paper. 

Definition  8.  A  hybrid  dynamical  system  is  specified  by  a 
triple  H  :=  ( D,F,R )  where: 

D  =  Ylj£jDj  is  a  hybrid  manifold; 

F  £  7(D)  is  a  hybrid  vector  field  on  D; 

R  :  S  T  is  a  hybrid  map,  S,T  C  dD  are  hybrid 
embedded  submanifolds,  and  S  has  codimension  1. 

As  in  [33],  we  call  R  the  reset  map  and  S  the  guard. 


Note  that  if  F  is  tangent  to  S  at  x  €  I),  there  is  a 
possible  ambiguity  in  determining  a  trajectory  from  x — one 
may  either  follow  the  flow  of  F  on  I)  or  apply  the  reset  map 
to  obtain  a  new  initial  condition  y  =  R(x). 

Assumption  2.  To  ensure  that  trajectories  are  uniquely 
defined,  we  assume  that  F  is  outward-pointing  on  S. 

To  the  best  of  our  knowledge,  this  definition  of  a  hybrid 
dynamical  system  has  not  appeared  before.  However,  in  light 
of  the  constructions  contained  in  this  section,  it  may  be 
seen  as  a  mild  generalization  of  a  simple  hybrid  system 
(cf.  §3.2  in  [33]).  Further,  in  Section  III-C  we  will  see  that 
this  definition  supports  powerful  geometric  analysis  of  the 
dynamics  near  a  hybrid  periodic  orbit.  Finally,  this  class  of 
hybrid  systems  encompasses  many  closed-loop  models  of 
legged  locomotion  [16],  [17],  [18],  [19],  [20],  [23],  [24], 
[26],  [27].  We  contend  that  these  facts  justify  the  introduction 
of  the  novel  definition. 

Remark  4.  ,4,v  defined  above,  hybrid  dynamical  systems 
possess  unique  executions  or  trajectories  from  every  initial 
condition.  This  fact  can  be  demonstrated  algorithmically.  For 
any  x  £  Dj,  obtain  the  maximal  integral  curve  of  F  \jj.. 
This  integral  cur\’e  must  either:  a)  continue  for  all  time;  b ) 
exit  Dj  without  intersecting  dDj  (in  which  case  execution 
terminates);  or  c)  intersect  the  boundary  at  y  £  dDj.  If 
y  €  S,  the  map  R  is  applied  to  obtain  a  new  initial  condition 
R(y)  £  T,  and  otherwise  execution  terminates. 

The  following  definition  enables  us  to  embed  smooth 
dynamical  systems  into  hybrid  dynamical  systems  in  such  a 
way  that  trajectories  of  the  smooth  system  are  preserved  in 
the  hybrid  system.  We  illustrate  the  use  of  this  construction 
by  giving  a  terse  description  of  trajectories  for  this  class 
of  hybrid  systems.  In  the  subsequent  sections,  we  use  this 
construction  to  state  the  main  results  of  this  paper. 

Definition  9.  A  hybrid  dynamical  embedding  of  a  dynamical 
system  ( M,G )  into  a  hybrid  dynamical  system  ( D,F,R )  is 
a  hybrid  embedding  f  :  M  — >  D  for  which  f*G  =  F |/(m) 
and  R\f(M)ns  *s  a  hybrid  dijfeomorphism  from  f(M)  D  S 
onto  f(M)  fl  T. 

Remark  5.  A  trajectory  of  a  hybrid  dynamical  system  H 
may  be  obtained  from  a  hybrid  dynamical  embedding  of  the 
system  (j,  jy),  where  J  CB  is  a  connected  interval. 

Definition  10.  A  r-periodic  orbit  of  a  hybrid  dynamical 
system  is  a  hybrid  dynamical  embedding  7  of  the  dynamical 
system  (S'1,  ^r§~)>  where  S 1  is  the  unit  circle. 

Remark  6.  We  alternately  refer  to  7  as  a  periodic  trajectory 
and  often  write  7  in  place  of  the  image  7(S1). 

B.  Hybrid  Poincare  map 

To  state  the  main  result  of  this  paper,  we  must  construct 
the  Poincare  map  associated  with  a  periodic  orbit  of  a 
hybrid  system.  This  has  been  developed  before  [24],  [32]; 
the  construction  is  more  delicate  than  for  smooth  systems 
since  trajectories  of  hybrid  systems  do  not  necessarily  vary 


continuously  with  initial  conditions.  We  directly  demonstrate 
this  continuous  dependence  in  the  construction  of  the  map. 

Let  H  =  ( D,F,R )  be  a  hybrid  dynamical  system  and 
7  a  periodic  orbit  of  H  with  period  r.  Then  7  undergoes 
a  finite  number  of  transitions  k  £  N,  so  we  may  index  the 
corresponding  sequence  of  domains  as3  D  \ , . . . .  Df..  Without 
loss  of  generality,  assume  the  Dj' s  are  distinct4;  let  7 j  := 
7  D  Tj  be  the  entry  point  of  7  in  Dj  and  let  77  be  the  time 
spent  by  7  in  Dj.  We  wish  to  construct  the  Poincare  map 
P  associated  with  7  over  a  neighborhood  of  7 j  in  T.  To 
do  this,  we  must  ensure  that  each  initial  condition  in  that 
neighborhood  has  a  well-defined  non-zero  first-return  time 
to  T;  the  following  assumption  guarantees  this. 

Assumption  3.  To  ensure  the  Poincare  map  is  well-defined, 
we  assume  F  is  transverse  to  T  and  not  outward-pointing. 

Now  for  j  =  1, ....  k  and  referring  to  Fig.  2  for  an 
illustration  of  these  objects,  let: 

<j>j  :  Tj  — ■>  Dj  be  the  maximal  flow  of  F  on  Dj\ 

Tj  C  f  fl  Dj  be  a  neighborhood  of  7 j  over  which 
Lemma  1  may  be  applied  between  T  and  S  on  Dj\ 
ipj  :  [0, 1]  x  Tj  — >  Dj  be  the  embedding  from  Lemma  1; 
Sj  :=  Vb(l>  Tj)  C  S  (T  Dj  be  the  image  of  Tj  in  S  under 
the  flow  on  Dj\ 

Rj  :  Sj  —>  T  denote  the  restriction  Rj  :=  R\s-\ 

Pj  :Tj  — >  T  be  defined  by  Pj(u)  :=  Rj(ipj(l,u)). 

The  Poincare  map  over  the  section  Tj  is  obtained  formally 
by  iterating  the  p's  around  the  cycle: 

Pj  :=  Pj~i  o  ■  ■  ■  o  pi  o  pk  o  ■  ■  ■  o  pj.  (1) 

The  neighborhood  Sj  C  Tj  of  7 j  over  which  this  map  is 
well-defined  is  determined  by  pulling  Tj  backward  around 
the  cycle, 

=  ( Pj 1  o  •  •  •  o  pf1  o  pf1  o  ■  ■  ■  o  p~\)  (Tj), 

and  similarly  for  any  iterate  of  Pj. 

It  is  a  standard  result  for  smooth  dynamical  systems 
that  Floquet  multipliers  (the  eigenvalues  of  the  linearized 
Poincare  map)  do  not  depend  on  the  choice  of  Poincare 
section  (cf.  Section  1.5  in  [13]).  The  following  lemma 
generalizes  this  result  to  the  hybrid  setting  by  demonstrating 
that  if  a  Poincare  map  obtained  from  one  domain  has  an 
attracting  invariant  submanifold  via  Lemma  3,  then  the  map 
obtained  in  any  other  starting  domain  has  a  diffeomorphic 
attracting  submanifold.  As  a  consequence,  non-zero  Floquet 
multipliers  are  shared  between  the  Pj' s  after  a  sufficient 
number  of  iterations. 

Lemma  4.  Let  j  £  {l,...,fc}  and  n  >  mirij  dim  Df.  If 
Pj 1  has  constant  rank  equal  to  r  near  7 j,  then  P"+1  has 
constant  rank  equal  to  r  near  ye  for  all  £  £  {1, ... ,  fc}. 

In  the  proof  of  Lemma  4,  we  make  use  of  an  elementary 
fact  from  linear  algebra.  The  result  is  easily  obtained  from 
Sylvester’s  inequality  (cf.  Appendix  A. 5.4  in  [34]). 

3 We  regard  subscripts  modulo  k  so  that  Df  =  Do. 

4Otherwise  we  can  find  { Bj  }  }  be  such  that  Bj  C  Dj  is  open,  7  C 

|Jj=1  Bj,  and  B,  n  Bj  =  0  if  i  7  .:/■  then  proceed  on  D  :=  Uj=i  Bj. 


Fig.  2.  Illustration  of  a  hybrid  domain  containing  part  of  a  periodic 
orbit.  The  periodic  orbit  7  enters  the  domain  Dj  inside  the  submanifold 
Tj  C  dDj  via  the  reset  map  Rj-i-  Initial  conditions  in  Tj  flow  to  the 
submanifold  Sj  C  dDj  via  the  vector  field  Fj.  The  map  'iftj  smoothly 
reparameterizes  these  trajectories  by  the  time  required  to  pass  from  Tj 
to  Sj,  thus  ipj  (a,  Tj)  is  an  embedded  submanifold  for  all  a  E  [0, 1] 
and  Sj  =  i/)j(l,Tj).  While  in  domain  Dj,  7  lies  in  the  invariant 
submanifold  Mj  constructed  in  Theorem  1.  By  construction,  Mj  is  an 
integral  submanifold  of  Fj  and  dim  Mj  <  dim  Dj",  see  Fig.  1  for  an 
illustration  when  dim  Mj  <  dim  Dj . 

Proposition  2.  For  j  £  {1, . . . ,  k},  suppose  aj  £  RnJ+ixnt 
where  rik  =  n\,  define  Aj  :=  a,—i  ■  ■  ■  aicik  ■  ■  •  a,j,  and 
let  n  >  min?  rij.  Then  for  all  l  £  we  have 

rank  A”+1  =  rankA”+1  =  rank  A], 

Proof,  (of  Lemma  4)  By  Lemma  3,  there  is  a  neighborhood 
Nj  C  Tj  of  7 j  on  which  Pf  has  constant  rank  equal  to  r. 
Fix  £  £  {1, . . . ,  k},  let  p^  :=  Pj-i  o  •  •  ■  o  pe,  and  define 
Ne  :=  (p,e)~1(Nj).  Then  C  is  a  neighborhood  of  7^ 
and,  for  all  x  £  Ne,  by  Sylvester’s  inequality 

rank(P”+1)*(x)  <  rank(P”)*  =  r. 

Furthermore  by  Proposition  2, 

rank(P;+1)*(7,)  =  rank(P;+1)*(7j) 

=  rank(P”)*(7j)  =  r. 

We  conclude  the  rank  of  P"+1  is  at  least  r  on  a  neighborhood 
Le  C  Tg  of  7^,  whence  rankP"+1  =  r  on  L(  D  Ng.  □ 

As  a  consequence,  if  the  Poincare  map  associated  with 
any  section  for  the  periodic  orbit  7  satisfies  the  hypotheses 
of  Lemma  3,  then  the  Poincare  map  associated  with  any 
other  section  also  satisfies  the  hypotheses. 

Remark  7.  It  may  he  easier  to  evaluate  the  rank  of  the 
Poincare  map  in  some  domains  than  others.  In  particular, 
if  Pj  is  a  diffeomorphism  for  some  j  £  {1, . . . ,  k},  then  all 
iterates  are  constant  rank. 

C.  Hybrid  Invariant  Subsystem 

This  section  contains  the  main  result  of  this  paper:  when 
iterates  of  the  Poincare  map  associated  with  a  periodic  orbit 
of  a  hybrid  dynamical  system  have  constant  rank,  trajectories 
starting  near  the  orbit  converge  in  finite  time  to  an  embedded 
smooth  dynamical  system. 

Theorem  1.  Let  H  =  ( I),  F,  R)  be  a  hybrid  dynamical 
system,  7  a  periodic  orbit  of  H,  and  suppose  the  composition 
of  any  Poincare  map  for  7  with  itself  at  least  mim,  dim  Dj 


times  has  constant  rank  equal  to  r  on  a  neighborhood  of  its 
fixed  point.  Then  there  is  an  (r  +  1)- dimensional  dynamical 
system  (M,  G),  a  hybrid  dynamical  embedding  f  :  M  — >  D, 
and  an  open  hybrid  set  W  C  D  so  that  7  C  f(M )  (T  W  and 
trajectories  starting  in  W  flow  into  M  in  finite  time. 

Proof.  By  assumption,  we  may  apply  Lemma  3  to  P  to 
obtain  a  neighborhood  N  C  Ti  of  7  IT  Tj,  an  embedded 
submanifold  E  C  Ti  containing  7  (T  Ti,  and  a  pair  of 
neighborhoods  U,V  C  E  of  7fTTj  so  that  P\jj  :  U  — >  V  is  a 
diffeomorphism  and  dim  U  =  r.  Now  we  consider  the  subset 
of  D  obtained  by  propagating  each  x  £  U  around  one  cycle. 
Let  U\  =  U  and  Uj  =  Pj-\(Uj-\)  for  j  =  2, . . . ,  k.  Away 
from  the  boundaries,  we  can  obtain  the  desired  set  directly 
from  ipj  as  Int (Mj)  :=  tpj(( 0, 1) ,  CP,).  For  j  =  2, . . . ,  k  —  1 
we  can  simply  attach  the  corresponding  boundaries  to  obtain 
Mj  :=  ipj([0,l\1Uj).  However,  since  we  may  not  assume 
U  C  V  or  V  C  U  (only  that  U  D  V  is  a  neighborhood  of 
7nXj),  we  must  be  careful  in  attaching  the  boundary  between 
Mk  and  Mi.  Thus,  we  let  Mi  =  -0i((0, 1],  C/i)  U  (Pi  D 
Pfc(Pfc))  andMfe  =  V'fc([0,l),Pfc)U(^fc(l,Pfc)nP^1(P1)). 
With  this  constmction,  for  each  j  =  1 , ...  ,k  we  have  that 
Mj  is  a  smooth  submanifold  with  boundary  dMj  C  Tj  U  Sj 
and  dMj  contains  both  points  in  7 j  (TcPT,  ;  see  Fig.  2  for  an 
illustration  of  Mj. 

Since  Mj  is  an  integral  submanifold  of  F  on  Dj,  the 
vector  field  P  restricts  to  Mj.  Letting  Gj  denote  this  restric¬ 
tion,  each  ( Mj,Gj )  is  a  smooth  dynamical  system  and  Gj 
points  inward  on  dMj  n  Tj  and  outward  on  dMj  IT  Sj .  Since 
P\u  is  a  diffeomorphism,  each  Rj\dM  ns  ’■  dMj  IT  Sj  — > 
dMj+ 1  IT  Tj+ 1  is  a  diffeomorphism  as  well.  Therefore  we 
may  glue  these  systems  together  one-by-one  via  Lemma  2  to 
obtain  a  smooth  dynamical  system  without  boundary  (M,  G) 
which  embeds  into  H  and  contains  7. 

Finally,  let  N,  U,  and  V  be  as  above  and  let  6  >  0 
be  an  arbitrary  positive  number.  Note  that  by  continuity 
of  P  and  the  time-to-impact  maps  of  Lemma  1,  there  is 
a  neighborhood  W\  C  N  C  Ti  of  7  IT  Ti  so  that  Pn  (W\ )  C 
U  IT  V  and  each  w  £  W\  flows  into  U  IT  V  before  time 
nT  +  S.  Since  the  Pfs  are  continuous,  for  j  =  2, . . . ,  k  there 
are  neighborhoods  Wj  C  Tj  of  7  IT  Tj  so  that  every  w  £  Wj 
flows  into  Wj. )_i  before  time  Tj  +  5/k.  Taking  the  union 
of  these  neighborhoods  as  W  =  Uj=i yields 
an  open  hybrid  submanifold  W  C  D  so  that  7  C  M  IT  W 
and  every  point  in  W  flows  into  W±  before  time  t  +  6,  and 
hence  into  M  before  time  (n  +  l)r  +  26',  see  Fig.  1  for 
an  illustration  of  these  neighborhoods  in  a  particular  two- 
domain  hybrid  dynamical  system.  □ 

Corollary  1.  7  is  asymptotically  stable  for  H  =  ( D,F,R ) 
if  and  only  if  7  is  asymptotically  stable  for  (M,  G). 

Proof.  Since  all  trajectories  in  a  neighborhood  W  of  7  reach 
M  in  finite  time  and  the  hybrid  flow  is  continuous  near  7, 
trajectories  in  W  will  converge  to  7  asymptotically  if  and 
only  if  trajectories  in  W  D  M  converge  to  7  asymptotically. 
This  occurs  precisely  when  7  is  asymptotically  stable  for 
(M,  G)  since  by  constmction  M  is  an  integral  submanifold 


of  F  and  R\MnS  '■  M  D  S  —>■  M  C\T  is  a  diffeomorphism. 

□ 
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For  (tp,x,x,y,y)  S  Da: 


If  each  of  the  Dj ’s  have  the  same  dimension  and  R  :  S  — > 
T  is  a  diffeomorphism,  the  rank  condition  of  Theorem  1 
is  trivially  satisfied,  and  we  can  globalize  the  construction 
using  Lemma  2.  This  provides  a  smooth  n-dimensional 
generalization  of  the  construction  in  [35], 

Corollary  2.  Let  H  =  ( D,F,R )  be  a  hybrid  dynamical 
system  with  D  =  U  .g  j  Dj,  R  :  S  T,  and  d  D  =  S  UT. 
If  dim  Dj  =  n  for  all  j  £  J  and  R  is  a  diffeomorphism, 
then  there  is  a  surjective  hybrid  dynamical  embedding  from 
an  n-dimensional  dynamical  system  (M,  G)  onto  H. 

IV.  Example 

A.  Hybrid  Floquet  Coordinates 

The  following  single-domain  system  clearly  satisfies  the 
hypotheses  of  Theorem  1,  and  demonstrates  the  canonical 
form  for  hybrid  Floquet  coordinates. 

Example  1.  Let  H  =  ( D.  F.  R)  be  a  hybrid  system  over 
the  single  domain  D  =  [0,1]  x  Rk  x  R^  with  vector  field 
F(t,  x,  z)  =  ^ +  Ekj=iP(t,x)ipr +  ELi9,(t,zl)§Ir, 
reset  map  R  :  {1}  x  Rfc  xl1  — >  {0}  x  Rfe  x  Rf  defined 
by  R(l,x,z )  =  (0 ,x,Az)  where  A  £  R^x<!  is  nilpotent, 
f(t,  f)  =  0  for  all  t  £  [0, 1]  and  some  £  £  Rfe,  and  gz(t,  0)  = 
0  for  all  i.  Consider  the  Poincare  map 

P:{  0}  x  Rk  xl'-*  {0}  x  Rfc  x  R*. 

It  is  clear  that  P( 0,  £,  0)  =  (0,  £,  0), 

Pl({ 0}  x  Rk  x  R*)  =  {0}  x  Rk  x  {0} , 

rank  f?.|{1}xRfcx{0}  =  k. 

Therefore  rank  Pk+(  =  k,  whence  we  may  apply  Theorem  1. 
The  resulting  smooth  invariant  subsystem  is  diffeomorphic  to 
S1  x  Rk. 

B.  Vertical  Hopper 

We  apply  Theorem  1  to  demonstrate  the  existence  of 
low-dimensional  invariant  dynamics  in  the  model  for  forced 
vertical  hopping  illustrated  in  Fig.  3a.  The  state  space  in 
the  aerial  phase  is  Da  :=  S 1  x  TR>o  x  TR.  Writing 
(<p,  x,  x ,  y ,  y)  £  Da,  the  aerial  dynamics  are  given  in  Fig.  3b. 
When  the  lower  mass  rests  on  the  ground,  the  state  space 
resides  in  Dg  :=  S1  x  TR  and  the  dynamics  of  the 
upper  mass  are  obtained  by  restricting  to  the  submanifold 
{(</>,  x,  x,  y,  y)  :  x  =  x  =  0}  as  in  Fig.  3b.  Transition  from 
the  aerial  to  the  ground  domain  occurs  when  the  lower  mass 
collides  with  the  ground,  and  the  state  is  reset  according  to 
(<p,  0,  x ,  y ,  y)  i— >  ((/),  y ,  y).  The  lower  mass  lifts  off  when  the 
normal  force  required  to  keep  it  from  penetrating  the  ground 
plane  becomes  zero,  i.e.  when  mg  =  —k£  o  —  a  sirup  +  ky , 
and  the  state  is  reset  via  (<p,y,y)  h- >  (</>,  0,  0,  y,  y). 


(j)  =  CD, 

mx  =  —  k£o  —  a  sin  <j> 

+  k(y  —  x)  —  bx  —  gm , 
My  =  klo  +  a  sin  </> 

-  Kv  -x)-  gM. 

For  (<f>,y,y)  £  Dg: 

<j>  —ui, 

My  =  k£ o  +  cl  sin  cf) 

—  ky  —  gM. 

(b)  hopper  dynamics 

Fig.  3.  Schematic  and  dynamics  of  vertical  hopper,  (a)  Two  masses  m  and 
M,  constrained  to  move  vertically  above  a  ground  plane  in  a  gravitational 
field  with  strength  g,  are  connected  by  a  linear  spring  with  stiffness  k  and 
nominal  length  £q.  The  spring  is  equipped  with  an  actuator  that  exerts  a 
phase-varying  force  asin</>  where  <j>  =  lj.  The  lower  mass  experiences 
viscous  drag  proportional  to  velocity  with  constant  b  when  it  is  in  the  air, 
and  impacts  plastically  with  the  ground  (i.e.  it  is  not  permitted  to  penetrate 
the  ground  and  its  velocity  is  instantaneously  set  to  zero  whenever  a  collision 
occurs),  (b)  Hopper  dynamics  in  aerial  and  ground  domains. 

Numerical  simulations5  indicate  that  with  parameters 
(m,M,k,bffo,a,u>,g)  =  (1,2,10,5,2,20,2^,2),  the  hy¬ 
brid  system  possesses  a  stable  periodic  orbit,  7.  Choosing 
a  Poincare  section  in  domain  Dg  at  <p  =  0,  we  find  that 
7  intersects  this  section  at  the  point  (y,y)  =  (1.96,1.88) 
and  that  the  eigenvalues  of  the  linearized  Poincare  map  are 
—0.25  ±  0.70 j.  Both  eigenvalues  lie  inside  the  unit  disc, 
corroborating  the  observed  stability  of  the  orbit.  Further, 
since  neither  eigenvalue  is  close  to  zero,  we  conclude  the 
Poincare  map  has  full  rank  equal  to  2  near  its  fixed  point. 
Therefore  by  Remark  7  the  hypotheses  of  Theorem  1  are 
satisfied,  and  we  conclude  the  system’s  dynamics  collapse 
to  a  smooth  3-dimensional  subsystem  after  one  hop. 

V.  Discussion 

We  demonstrated  the  existence  of  a  locally  attracting 
constant-dimensional  invariant  subsystem  near  a  hybrid  peri¬ 
odic  orbit  whenever  iterates  of  the  associated  Poincare  map 
have  constant  rank.  Under  a  genericity  condition,  near  a 
periodic  orbit  of  a  smooth  dynamical  system  there  exist 
Floquet  coordinates  in  which  the  dynamics  decouple  into 
a  constant-frequency  phase  variable  and  a  time-invariant 
transverse  linear  system  [11],  [12],  [13].  Under  the  additional 
rank  hypothesis  of  Theorem  1,  we  obtain  a  canonical  form 
for  the  Floquet  stmcture  of  a  hybrid  periodic  orbit.  Indeed, 
the  smooth  subsystem  (M,  G)  foliates  the  dynamics  near 
the  periodic  orbit  in  each  domain.  Thus  the  behavior  of 
the  hybrid  system  near  the  orbit  is  a  trivial  extension  of 
the  behavior  of  a  smooth  system — portions  of  the  smooth 

5  Note  that  simulation  of  hybrid  dynamical  systems  is  non-trivial.  We 
make  use  of  a  recently-developed  algorithm  with  desirable  convergence 
properties  [36].  In  particular,  we  use  Euler  step  size  /i  =  1  x  10“ 3  and 
relaxation  parameter  e  =  1  x  10— 12 .  As  a  note  to  practitioners,  we  found 
that  numerical  linearization  of  the  Poincare  map  via  finite  differenes  was 
sensitive  to  the  coordinate  displacement  when  using  large  values  for  the 
relaxation  parameter.  The  sourcecode  for  this  simulation  is  available  online 
at  http  :  //purl .  org/ sburden/ cdc2011 


(a)  vertical  hopper  schematic 


dynamics  are  “stacked”  in  transverse  coordinates  and  anni¬ 
hilated  within  a  finite  number  of  cycles  via  a  nilpotent  linear 
operator.  On  the  smooth  subsystem,  the  standard  construction 
of  Floquet  coordinates  may  be  applied,  generalizing  the 
class  of  systems  which  may  be  analyzed  using  the  empirical 
approach  developed  in  [14],  [15]. 

In  addition  to  providing  a  canonical  form  for  the  dynamics 
near  such  non-degenerate  periodic  orbits,  the  results  of 
this  paper  suggest  a  mechanism  by  which  a  many-legged 
locomotor  may  formally  collapse  a  large  number  of  degrees- 
of-freedom  to  produce  a  low-dimensional  coordinated  gait. 
This  provides  a  link  between  currently  disparate  lines  of 
research,  namely  the  formal  analysis  of  hybrid  periodic 
orbits,  the  design  of  robots  for  locomotion  and  manipulation 
tasks,  and  the  scientific  probing  of  neuromechanical  control 
architectures  in  organisms.  It  shows  that  hybrid  models 
naturally  exhibit  dimension  reduction,  that  this  reduction  may 
be  deliberately  designed  into  an  engineered  system,  and  that 
evolution  may  have  exploited  this  reduction  in  developing  its 
spectacular  locomotors. 
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